1 Value Surface

1.1 Estimated Value Function Using Normalized IPW

Figure 1.1: Estimated value of regime using normalized IPW

1.2 value Surface using MSM

Figure 1.2: Estimated value surface of regime using quadratic MSM and scatter plot of normalized IPW estimates.

2 Matern 5/2 GP Graphics

2.1 Interpolating GP

Figure 2.1: Estimated value of regime using interpolating GP after an additional 25 sampled points

2.2 Homoskedastic GP

Figure 2.2: Estimated value of regime using homoskedastic GP after an additional 25 sampled points

2.3 Heteroskedstic GP

Figure 2.3: Estimated value of regime using heteroskedastic GP after an additional 25 sampled points

3 Matern 3/2 GP Graphics

3.1 Interpolating GP

Figure 3.1: Estimated value of regime using interpolating GP after an additional 25 sampled points

3.2 Homoskedastic GP

Figure 3.2: Estimated value of regime using homoskedastic GP after an additional 25 sampled points

3.3 Heteroskedastic GP

Figure 3.3: Estimated value of regime using homoskedastic GP after an additional 25 sampled points